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ABSTRACT 


Consider  a unit  in  continuous  operation.  When  this  unit  fails, 

it  is  immediately  replaced.  In  addition,  opportunities  arise 

according  to  a renewal  process  when  we  can  either  replace  this 

unit  at  a reduced  cost  or  do  nothing.  The  problem  is  formulated 

as  a Markov  decision  process.  If  the  unit  has  increasing  failure 

rate , the  replacement  policy  that  minimizes  the  expected  total 

discounted  cost  or  the  average  cost  of  maintenance  is  characterized 

■k 

by  a single  parameter  i>k  : If  an  opportunity  exists,  we  replace 

the  working  unit  only  if  its  age  exceeds  itf  . Techniques  to 
compute  the  minimum  discounted  cost  and  the  optimal  policy  are 
suggested. 

Under  this  simple  replacement  policy  structure,  the  operating 
characteristics  of  the  system  are  discussed  for  the  special  case 
where  the  opportunities  arise  according  to  an  exponential  arrival 
process. 

A series  system  of  two  units  where  the  failure  of  either  unit 
is  also  an  opportunity  to  replace  the  other  unit  at  a reduced  cost 
is  considered.  When  the  units  have  increasing  failure  rate,  the 
structure  of  the  optimal  policy  is  again  determined. 
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CHAPTER  1 


INTRODUCTION 


1.1  Introduction 


The  interest  and  the  literature  on  decision  models  for  main- 
tained systems  continues  to  grow.  These  models  share  a common 
objective  of  reducing  the  incidence  of  system  failure  or  the  cost 
of  maintenance  over  a certain  time.  However,  differing  assumptions 
on  the  life  distribution  of  the  items,  the  repair  facilities  and 
costs,  and  the  available  information  on  the  system  have  led  to 
different  models  and  solution  techniques. 

Opportunistic  models  describe  situations  where  it  costs  less 
to  replace  (or  repair)  two  or  more  units  concurrently  than  to 
replace  them  at  different  times.  Thus  the  necessary  replacement 
of  a unit  upon  its  failure  may  also  justify  the  replacement  of 
some  other  units  whose  failure  seems  imminent.  These  cost  advan- 
tages are  often  due  to  reduced  overhead  costs  in  joint  replacements 
and  the  economies  of  scale.  Typically,  the  replacement  of  an  item 
upon  failure  is  viewed  as  an  opportunity  to  replace  other  nonfailed 
items  in  the  system  at  a reduced  cost.  Such  a situation  may  arise 
when  a system  is  sent  to  the  repair  shop  for  parts  replacement. 

Upon  the  failure  of  some  critical  component,  a large  cost  is  in- 
curred in  transporting  the  system  to  the  repair  shop  and  due  to 
services  lost  while  the  system  waits  for  repair.  Along  with  the 
necessary  replacements,  one  may  now  choose  to  replace  several 
other  items  at  their  marginal  cost  of  replacements  These  replace- 
ments are  called  opportunistic  as  opposed  to  the  necessary  failure 
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replacements.  The  criterion  for  deciding  whether  an  item  should 
be  opportunistically  replaced  or  not  is  called  an  opportunistic 
policy.  These  replacement  policies  and  the  advantages  in 
instituting  them  are  largely  the  subject  of  this  thesis. 

First,  we  review  some  of  the  better  known  replacement  models 
and  the  situations  they  describe. 

1 . 2 Replacement  Models 

In  replacement  models  that  seek  to  reduce  maintenance  costs, 

we  look  for  two  things.  First,  the  replacement  of  a unit  before 

failure  must  cost  less  than  a failure  replacement.  Secondly, 

the  unit  of  interest  must  deteriorate  in  service.  One  measure 

of  deterioration  with  age  is  called  the  increasing  failure  rate 

(IFR) . If  the  unit  has  failure  distribution  F with  density 

function  f , then  the  failure  rate  function  r(t)  « f(t)/l  - F(t)  . 

In  the  area  of  preventive  maintenance,  the  best  known  results 

are  for  the  planned  age  replacement  models  (see  Barlow  and  Proschan 

[1965]).  Consider  a unit  whose  replacement  upon  failure  costs 

and  whose  replacement  before  failure  costs  C2  < . 

When  the  failure  distribution  F is  continuous,  the  policy  that 

minimizes  the  expected  cost  per  unit  time  for  an  infinite  horizon 

•k 

problem  is  nonrandom:  There  exists  some  t e [O,00]  such  that 

k 

we  replace  the  unit  either  upon  failure  or  at  age  t whichever 

comes  first.  When  the  failure  rate  is  continuous  and  strictly 

* 

increasing,  the  optimal  replacement  age  t is  finite  and,  is 
the  unique  solution  to 
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r(t)  f (1  - F(x))dx  - F(t)  =■  c--_2  c . 

0 12 

In  addition  to  this  model  for  a single  unit  system,  Barlow 

and  Hunter  [1960]  introduced  an  age  replacement  policy  for  a 

complex  system  sustained  with  minimal  repair.  The  system  is 

replaced  or  overhauled  at  age  T at  a cost  . Intervening 

failures  are  rectified  at  cost  C2  through  minimal  repair  which 

does  not  alter  the  failure  rate  of  the  system.  When  the  system 

failure  rate  is  continuous  and  strictly  increasing,  the  optimal 
* 

replacement  age  T is  again  finite  and  unique.  As  before,  it 
may  be  determined  by  minimizing  the  long-run  expected  cost  per 
unit  time  over  T . 

Various  other  extensions  to  the  basic  model  have  been  made. 

Fox  [1966]  showed  that  the  age  replacement  policy  also  minimizes 
the  total  expected  discounted  cost  of  maintenance.  Schaefer 
[1971]  and,  Wolfe  and  Subramanian  [1974],  introduced  an  age 
dependent  cost  in  the  model  to  reflect  the  decrease  in  efficiency 
of  the  system  with  age. 

When  maintenance  costs  over  a finite  time  period  are  of 
concern,  a sequential  replacement  policy  is  always  better.  In 
this  case,  every  successive  replacement  age  is  different  and  is 
chosen  to  minimize  the  expected  costs  over  the  time  still  remaining. 
Barlow  and  Proschan  prove  that  the  optimal  sequence  of  replacement 
times  is  nonrandom  and  illustrate  its  calculation  in  [1962]  and 
[1965]. 
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For  ease  of  implementation,  the  block  replacement  policy  has 
also  received  attention.  Under  this  policy  items  of  a given  type 
are  replaced  at  failure  and  at  times  kT  (k  = 1,2,  ...)  . Let 
and  C2  be  the  costs  of  a failure  replacement  and  a planned 
replacement  respectively.  If  N(T-)  is  the  expected  number  of 
failures  in  time  T , the  expected  cost  per  unit  time  for  an 
infinite  horizon  problem  may  be  expressed  as 

CjNCT)  + C2 

T * 

Minimizing  this  over  T determines  the  optimal  replacement 
interval.  Barlow  and  Proschan  derive  this  result  and,  compare 
it  to  the  age  replacement  policy  in  [1965]  and  [1975], 

The  periodic  and  sequential  replacement  policies  referred 
hereto  describe  single  component  systems.  These  policies  extenci 
to  multi-component  systems  if  we  assume  stochastic  and  economic 
independence  between  the  components.  In  such  a case,  the  optimal 
policy  for  the  system  is  effected  by  optimally  maintaining  each 
component.  One  generalization  of  this  model  would  be  a recognition 
of  some  form  of  economic  dependence  between  the  components.  For 
instance,  opportunistic  policies  assume  there  are  economies  of 
scale  in  undertaking  joint  replacements.  Because  of  the  complexity 
of  these  models  in  general,  only  a few  special  situations  have 
been  analyzed. 

Radner  and  Jorgenson  (see  [1962]  and  [1963])  consider  a series 
system  of  two  components,  designated  0 and  1.  Unit  0 has  an 
increasing  failure  rate.  Suppose  it  costs  Cq  to  replace  it  upon 
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extensions  by  Klein,  ([1962]),  give  the  decision  rules  that 
minimize  the  cost  of  maintenance. 

Rosenfield  considers  the  above  model,  ([1974]),  with  the 
added  complexity  of  uncertainty  about  the  state  of  the  system. 

He  assumes  that  at  any.  period  we  may  replace  the  unit,  or  inspect 
it,  or  do  nothing.  In  every  instance  an  expected  operating  cost 
is  incurred.  Besides,  a replacement  or  an  inspection  cost  is 
associated  with  the  first  two  actions.  Optimal  decision  policies 
that  minimize  the  total  discounted  cost  of  maintenance  are  deduced. 

Finally,  a recent  survey  of  maintenance  models  by  Pierskalla 
and  Voelker  [1975]  is  mentioned  as  an  exhaustive  source  of 
references  and  related  research  efforts. 

1.3  Thesis  Plan 

In  Chapter  2,  we  develop  an  opportunistic  replacement  model 
for  a single  unit.  When  this  unit  fails  it  is  immediately  replaced. 
In  addition,  opportunities  arise  according  to  a renewal  sequence 
when  we  can  replace  this  unit  at  a reduced  cost  or  do  nothing. 

The  opportunities  could  be  the  visits  of  the  repairman  or  the  shut- 
downs of  the  system  of  which  this  unit  is  a critical  component. 

The  system  is  modeled  as  a Markov  Decision  Process,  and  the  optimal 

i 

policy  structure  for  the  average  cost  and  the  total  discounted  cost 
criterions  is  established  when  the  unit  is  IFR.  This  model  also 
adapts  itself  to  seek  marginal  improvements  in  complex  systems, 
j However,  the  case  of  a series  system  of  two  units  is  explicitly 

| considered.  Here,  we  assume  that  the  failure  of  either  unit  is 

I an  opportunity  to  replace  the  other  unit  at  a reduced  cost. 

I 

1 

| 

-I 

;!  | 

( 
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Whan  the  units  are  IFR,  the  structure  of  the  optimal  policy  is 
again  determined. 

Chapter  3 considers  the  opportunistic  replacements  of  a 
unit  where  the  opportunities  arise  according  to  a Poisson  process. 
For  this  special  case,  the  exact  solution  of  the  optimal  policy 
is  determined.  The  operating  characteristics  of  this  model  are 
studied  in  detail.  In  addition,  various  classes  of  distributions 
for  Unit  1 and  ti.air  interaction  with  an  opportunistic  policy 


are  considered. 
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CHATTER  2 


OPTIMAL  OPPORTUNISTIC  POLICIES 


2.1  Introduction 


This  chapter  establishes  the  structure  of  the  optimal  oppor- 
tunistic replacement  policy  for  two  specific  cases.  In  either 
case,  techniques  to  estimate  the  minimum  cost  objective  and  the 
parameters  of  the  policy  are  suggested.  The  applications  and 
extensions  of  these  basic  models  are  stressed  by  way  of  examples. 

First,  in  Section  2,  we  consider  a single  unit  in  continuous 
operation.  When  this  unit  fails  ifc  is  immediately  replaced.  In 
addition,  opportunities  arise  according  to  a renewal  sequence  at 
which  times  we  can  replace  this  unit  at  a reduced  cost  or  do 
nothing.  When  the  unit  has  increasing  failure  rate,  the  replacement 

policy  that  minimizes  the  cost  of  maintaining  the  unit  is  charac- 

* 

terized  by  a single  parameter  i : If  an  opportunity  exists,  we 

* 

replace  the  working  unit  only  if  its  age  exceeds  i . 

In  Section  3 we  consider  a critical  system  of  two  units  where 

the  failure  of  either  unit  is  an  opportunity  to  replace  the  other 

unit  at  a reduced  cost.  When  the  units  have  increasing  failure 

rates,  the  optimal  replacement  policy  is  characterized  by  two 

£ 

parameters,  i and  j : If  Unit  1 (or  Unit  2)  fails,  we  replace 

& 

both  units  only  if  the  age  of  the  working  unit  exceeds  i 
* 

(or  j ).  In  any  case,  the  failed  unit  is  immediately  replaced. 

All  the  replacement  models  treated  in  this  chapter  are  modeled 


as  Markov  Decision  Processes  and  solved  explicitly  in  discrete 
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l 
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time  space.  The  results  for  the  continuous  distributions  follow 
immediately.  A review  of  the  basic  methodology  follows.  An 
extensive  treatment  of  this  subject  can  be  found  in  (Derman  [1970]) 
and  (Ross  [1970]). 

Let  random  vector  Xt  be  the  state  of  the  system  at  time 
t - 0,1,2,  ....  We  observe  = i , and  choose  an  action  &t 
from  a finite  set  of  choices.  In  doing  so,  we  incur  a cost 
C(i,at)  and  our  next  state  Xt+^  c 1 with  probability  P^(afc)  . 
Let  tt  be  the  policy  or  rule  for  choosing  the  actions.  We  wish 
to  determine  a it  that  minimizes  the  "cost  of  maintaining  the 
system"  One  measure  of  our  objective  is  the  total  expected  dis- 
counted cost  V . Given  initial  state  i , and  policy  ir  we 
define 

(1)  Vw(i)  = {c(X0,a0)  + ctC(Xr,av)  + a2C(X2,a2)  + •••  | XQ  * i } 


where  a is  the  rate  at  which  future  costs  are  discounted.  For 
a < 1 and  C(  , ) < « , V^(i')  is  finite  and  a meaningful  objective. 
Let 

V(i)  = Min  V (i)  . 

“ 7T  *" 

TT 

Under  our  assumptions,  an  optimal  policy  that  is  stationary  (i.e. 
depends  only  on  the  state  of  the  system)  exists  (for  proof  see  Ross 
[1970],  Theorem  6.3).  Let  it  be  it  . Under  policy  tt  , V(«) 
satisfies  the  functional  equation 
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I 

i 

t 


i, 


if 


(2) 


V(i) 


Min 

a 


jc(i,a)  + a l P^CaWjjj 


for  all  i 


Another  objective  of  interest  is  the  expected  average  cost 
of  maintaining  the  system,  $(•)  • Given  intial  state  i , and 
policy  tt  , we  define 


= Lim  E 

71 

nr**0 


,Jo  C(Xt,at)  | XQ.ij 

" OTTTj  ' 


•k 

We  say  policy  7r  is  optimal  if 


d>  *(i)  = Min  <f>  (i)  for  all  i . 

* - 77  - — 

77  TT 


In  the  replacement  models  to  follow,  we  minimize  the  two  cost 

objectives  defined  above  and  deduce  the  nature  of  the  optimal 
* 

policy  tt  . 

2.2  Opportunistic  Replacements  of  a Single  Unit 
2.2.1  The  Model 

We  motivate  the  formulation  of  the  problem  by  two  examples. 
Example  (1): 

Consider  a unit  that  is  in  continuous  operation.  When  this 
unit  fails,  an  emergency  crew  is  called  to  replace  it  immediately 
at  a cost  (K  + C)  . In  addition,  a repairman  visits  the  facility 
periodically  and  offers  to  replace  the  (working)  unit  at  a reduced 
cost  C . If  we  choose  to  replace  the  unit,  we  save  K dollars 


i 
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but  sacrifice  the  remaining  life  of  the  unit  in  operation.  Clearly, 
every  visit  of  the  repairman  is  a decision  state  where  we  may 
replace  the  working  unit  or  forego  the  chance. 

Suppose  the  unit  has  a discrete  failure  probability  density 
g , i = 0,1,2,  ...  . The  repairman's  visits  are  also  random  with 
probability  density  f^  , i = 0,1,2,  ...  and  fg  < 1 . Suppose 
that  replacements,  whether  opportunistic  or  upon  failure,  take  1 
unit  of  time.  First,  we  minimize  the  total  expected  discounted 
cost  of  maintaining  the  unit.  If  future  costs  are  discounted 

at  rate  a < 1 and  (K  + C)  < “ , then  V is  finite.  This 

TT 

follows  from  the  upper  bound 

<_  (K  + C)  + a(K  + C)  + a^(K  + C)  + •••  for  any  policy  r 

< CO 

which  is  obvious  if  we  note  that  (K  + C)  is  the  maximum  we 
spend  in  any  period. 

Example  (2): 

The  above  problem  is  equivalently  defined  by  the  following 
system.  Unit  1 is  in  series  with  sub-system  2.  When  1 fails  we 
replace  it  at  cost  (K  + C)  where  K is  the  cost  of  system 
failure.  Failure  epochs  of  2 constitute  a renewal  sequence  and 
are  potential  opportunities  to  replace  1 at  reduced  cost  C , 
and,  are  equivalent  to  the  repairman's  visits  in  Example  (1).  As 
before,  let  the  failure  densities  of  1 and  2 be  g^  and  f^  . 

Suppose  replacements  of  1 or  2 or  both  take  one  unit  of  time. 
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is  now  the  cost  associated  with  maintaining  Unit  1 under  some 
replacement  policy  tt  . 

For  convenience,  we  shall  follow  Example  (2)  for  further 
developments.  Define  the  system  state  by  a pair 

(i,j)  where  i : age  of  Unit  1 

j : is  the  time  left  to  the  failure  of  sub-system  2. 

Note  that  the  option  to  replace  1 or  not  arises  only  when  sub- 
system 2 fails,  i.e.  j = 0 ; So  (i,0)  is  the  only  decision 
state.  When  j / 0 , we  do  not  know  its  value,  nor  do  we  need  to 
know  it  since  (i,j)  , j f 0 , is  not  a decision  state. 

Let  be  the  conditional  probability  of  failure  at  age 

i of  Unit  1 given  survival  to  age  i - 1 . is  the  discrete 

analog  of  the  failure  rate  (see  Barlow  and  Proschan  [1965])  and. 


R, 


k>i 


If  V(i,j)  is  the  minimum  ca:"  objective  given  we  are  in 
state  (i,j)  , it  obeys  the  functional  ?;'»\-tions 


(4a) 

and, 

(4b) 


V(i,j;)  - ^ {K  + C + aV(0,j  - 1)}  + 

(1  - R^  • aV(i  + l,j  - 1)  for  j > 0 


V(i,0) 


;4 


R,  < C + a 


l f.jV(0,j)j  + (1  - R±)-  • 


Min 


;C  + a 


l £,VfO,j);a  l f,V(i  + 1,3) 
j J j 3 


4 


fi 


j 
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When  we  are  in  state  (i,j)  , j t 0 , with  probability  R^  Unit  1 
will  fail  and  the  state  cr‘  the  system  at  the  next  time  period  will 
be  (0,j  - 1)  . This  .‘..tail  an  immediate  expense  of  (K  + C) 

for  system  breakdown  v»  ,•  f I i^^.ent  plus  the  discounted  value 
of  expected  future  costs  v dch  is  aV(0,j  ~ 1)  . In  this  we 
assume  that  we  continue  ?.  ■ aintain  the  system  using  the  best 

available  strategy.  This  jcuounts  for  the  first  term  in  Equation 
(4a).  Similarly,  the  second  term  of  Equation  (4a)  is  the  survival 
probability  of  Unit  1 multiplied  by  the  discounted  value  oj  future 
costs  if  Unit  1 does  not  fail.  Equation  (4b)  refers  to  the  decision 
state.  When  j = 0 (i.e.  sub-system  2 fails)  and  Unit  1 fails 

concurrently,  we  take  the  opportunity  at  hand  and  spend  only  C 
to  replace  Unit  1.  Our  next  state  is  (O.j)  with  probability  f . 


So,  the  total  expected  cost  is  jc  + a \ f^V(0,j)|  . This  accounts 

for  the  first  term  in  (4b).  If  1 does  not  fail,  we  either  replace 
it  and  expect  to  spend  C + a £ f.V(0,j)  , or,  do  not  replace  it 

j J 

and  expect  to  spend  a ][  f . (i  +-l,j)  depending  on  which  is  less, 

j 3 

We  now  turn  our  attention  to  evaluating  the  optimal  objective 

* 

V(i,j)  , and,  the  structure  of  the  associated  optimal  policy  it 

If  Unit  1 has  increasing  failure  rate  (R^  + i)  , we  show  that 

V(i,j)  is  monotnsic  in  i , and  ir  has  the  following  simple 

A 

structure:  There  exists  i e (0,°°)  such  that  whenever  we  are  in 

A 

a decision  state  (i,0)  , replace  Unit  1 only  if  i >_  i . 


2.2.2  Computation  of  thy  Cost  Objective 


An  explicit  solution  of  the  functional  equations  for  V(i,j) 


is  near  impossible.  However,  an  interation  technique  for  approaching 
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functional  equations  is  available.  Let  Vg(i,j)  «*  0 for  all 
i , j and,  define  successive  approximations  by 


(5a) 


and 


(5b) 


\+l(itj)  85  \ {K  + C + aVk(0,j  - 1)}  + (1  “ Rj ) 
aVk(i  + J J - 1)  for  j > 0 


\+l(i’0)  " R 


Min 


i (c  + ° | + « - V 

C + . I fjVj.W.jJja  | fJVk(l  + 1,3  )j  . 


For  example,  when  k = 0 Equations  (5a)  and  (5b)  would  yield 

V^i.j)  = R±(K  + C)  for  j > 0 

and. 


V-^i.O)  =•  R±  • C . 

rntuitively,  Vk(i,j)  is  the  cost  if  we  follow  policy  ir  for 
k periods  and  incur  a terminal  cost  of  zero,  given  we  start  in 
state  (i,j)  . Given  it  < 3.  , it  follows  that 

Vk+i(i,j)  > Vk(i,j)  for  all  i , j , k and, 

Lim  V (i,j)  = V (i, j ) for  all  i , j . 

•k+oo 

Equations  (5a)  and  (5b)  give  an  easy  technique  to  evaluate  V 
in  terms  of  K , C , R , g and  a . In  addition,  they  will  be 
helpful  in  establishing  the  iaonoconicity  of  V in  i , the  age 


of  Unit  1. 


15 


2.2.3  Optimal  Policy  Structure 

\ As  a necessary  prelude  to  establishing  the  structure  of  the 

optimal  policy,  we  first  show  the  monotonicity  of  V(i,j)  in  the 
age  of  Unit  1. 

Lemma  2.1: 

If  Unit  1 has  increasing  failure  rate  (R^  I i)  , and 
K , C > 0 , then  for  all  k 

(a)  Vk(i,j)  + * for  all  j . 

(b)  K + C + aVk(0,j)  loVk(i,j)  for  all  i , j . 

I Proof: 

For  k = 0 , Vg(i,;j)  = 0 for  all  i,  j by  definition. 

^ Therefore  (a)  and  (b)  are  trivially  true.  The  proof  proceeds 

. 

by  induction  on  k . Suppose  (a)  and  (b)  are  true  for  some  k . 

First,  we  show  V r(i,j)  + i for  all  j . 

KtJ. 

Case  (i):  j > 0 

Rewriting  the  recursive  Equation  (5a), 

Vk+l(i’j)  = Ri  {Z+C  + aVk(0,j  -l}  + (l-R^aV^i  + l.j-l) 

» \ {K+C  + oVk(0,j -1)  - aVk(i  + l,j-l)>  + oVk(i  + l,j-l) 

-Ri+1  {K+  C+  aV0»j_1)  - aVk(i  + l,j-l)}  + oVk(i  + l,j-l) 

= Ri+1  {K+C  + aVk(0,j-l)}  + (1-Ri+1)  • dVk(i  + l,j-l) 

< R1+1  {K  + C + aVk(0,j  - 1) ) + (1  - R±+1)  • aVk_(i  + 2, j - 1) 

> - vk+1(i  + i,j)  . 

i 

ft  V / 


L 


I 
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The 


first  inequality  is  true  since  R^+^  — ^i  anc*  t^8  coe^^^-c^ent 
of  is  nonnegative  by  the  induction  hypothesis  (b) . The  second 

inequality  follows  from  induction  hypothesis  (a),  namely  + i . 


Case  (ii) ; j » 0 


First  note  that 


(6) 


Vk(i,j)  + i for  all  j 

I (i  + l,j)  + i 
j 15  * 


Min 


|c  + o | fjVk(0,j);a  | fjVJt(i  + l,j)|  i i 


Now, 


Vk+i(i,0)  - R±  |c  + a l fjVk(0,j)|  + (1  - R±)  * Min  jc  + a £ fjV°,J)j 


a l fjVk(i  + l,j)| 


j 


- Ri+1 


Min 


|c  f a I t^VO-J)}  + » - Ri+1>  • 

jc  + a l fjVk(0,j);a  J fjVk(i  + l,j) 
jc  + a l + (1  - Ri+1)  • 


- Ri+1 

Min  |c  + a | f^Vk(0,j);a  j>  f^V^i  + 2,j) 
" \+l(i  + l’°>  * 


The  first  inequality  follows  from  R^+1  >_  R^  and 

C + a 1 fjVk(0,j)  > Min  jc  + a £ £ f^i  + l,j)|  . 


j 


5 


i 


i 
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The  second  inequality  follow  from  (6). 

We  have  shown  V^+^(i,j)  i i for  all  j . It  still  remains 
to  show  that  Part  (b)  is  true  for  (k  + 1)  . That  is, 

(7)  K + C + ctVk+1(0,j)  iaVk+1(i,j)  for  all  i , j . 

For  j > 0 , 

L.H.S.  = (K+C)  + aRQ  (K+C  + aVk(0,j -1)}  +a2(l-RQ)  • Vfc(l,j  - 1) 

= (K  + C)  + aRQ(K+C)  + a2  [R^O.j-l)  + (l-R0)Vk(l,j  - 1)] 

1 (K+C)  + aR0(K+C)  + a2  [RQVk(Of  j - 1)  + (1  - RQ)Vk(0, j - 1)] 

(by  the  induction  hypothesis  Vk  i i) 

= (K+C)  + ocR0(K+C)  + a2Vk(0,j-l)  - A 
R.H.S . = a (R±  (K+C  + aVk(0,j -1)}  + (1-R^  • aVk(i  + l,j  - 1)] 

<_a  [R±  {K+C  + aVk(0,  j -1)>  + (1  - R±)  - {K+C  + aVk(0,j  - 1)}) 

(by  the  induction  hypothesis  (b) ) 


- a(K+C)  + a2Vk(0,j  -1) 

< A , (by  inspection)  . 

When  j = 0 Equation  (7)  follows  similarly.  ■ 


I 
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Theorem  2.2: 


If  Unit  1 is  IFR,  and  K , C > 0 , then  there  exists  an 
i e (0,®)  such  that  when  in  state  (i,0)  , 


(a)  replace  Unit  1 if  i > i 

* 

(b)  do  not  replace  Unit  1 if  i < i 

(c)  i*  - Min  ji  : a £ f^VCiJ)  > C + 


a I fjV(0,j)| 


Proof; 


As  k -*■  ® , Lemma  2.1  implies  V(i,j)  + i for  all  j 
nerefore,  a J.  f^V(i,j)  + i . 


Define  i = Min  |i  : o J f^V(i,j)  > C + a £ f.,V(0,j) 


j 


Then,  for  all  states  (i,0)  where  i >_  i , 


a l f.V(i.j)  > C + a l f,V(0,j) 
j.  3 j 2 


and  replacing  Unit  1 minimizes  the  cost  objective.  .The  above 

* _ 
structure  of  n follows.  ■ 


To  compute  the  optimal  policy  parameter  i , let  us  define 


i (k)  *=  Min 


f1!i 


I > C + a l fjVk(0 

Min  {±  a | fjCV^CiJ)  - Vk(0,j))  > C j. 


,j)| 


It  is  unfortunate  that  i (k)  is  not  monetonic  in  k and  cannot 
serve  as  a bound  on  i*  . We  show  tjiis  by  a simple  counterexample. 


X 
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2.2.4  Extensions  of  the  Model 

One  extension  of  the  model  is  immediate.  When  Units  1 and  2 
have  continuous  density  functions j the  above  results  are  true  for 
any  discrete  approximation  of  the  failure  rate  function  of  Unit  1 
and  the  density  function  of  Unit  2,  as  well  as  for  the  limiting 
continuous  functions. 

To  establish  the  optimal  policy  that  minimizes  the  expected 
cost  per  unit  time  we  indicate  the  approach  suggested  in  (Ross  [1970]). 
For  the  discounted  cost  model  with  discount  factor  a , we  define 

ha(i,j)  = V (i, j ) - V(0,0)  . 


The  functional  equations  (4a)  and  (4b)  can  then  be  rewritten  as 


(8a) 


(1  - o)V(O.O)  + ha(i,j)  - \ (K  + C + aha(0,j  - 1))  + 
(1  - R ) • aha(i  + l,j  - 1)  for  j > 0 


and, 


(8b) 


(1  - ct)V(0,0)  + ha(i,0)  = R±  jc  ■*'  q | f^h^CO, j.)|  + 
(1  - R±)  • Min  jc  + a l f^h^O,  j)  ;a  £ f^Oi  + l,j)|  . 


When  X and  C are  finite  we  note  that  V(i,j)  - V(0,o)  < ® 

for  all  i , j and  a . Under  this- condition r ha  (i,j)  converges 

n 

to  a bounded  function  h(i,j)  and,  (1  - an)V(0,0)  converges  to 
a constant  g for  some  sequence  1 (for  proof  see.  Ross  [1970], 

Section  6.7).  In  the  limit,  Equations  (8a)  and  (8b)  become 


! 

! 


i 


i 
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(9a) 


g + h(i,j)  « R±  (K  + C + h(0,j  - 1)}  + 


(1  - R±)  • h(i  + l,j  - 1)  for  j > 0 


and , 


(9b) 


(1 


g + h(i,0)  = ,Ri  |c  + l fjh(0,j)|  + 

- RjL)  • Min  |c  + I fj h(0,j);  jj  fjh(i  + l,j)|  . 


* 


When  Equations  (9a)  and  (9b)  uphold,  the  optimal  policy  it  is 

stationary  and  the  minimum  average  cost  of  maintenance  is  g . 

* 

To  define  it  for  the  average  cost  objective,  first  note  that 


V(i, j)  + i for  all  j =>  h(i,j)  t i for  all  j 

=*>  l f h(i,j)  + i . 
j 2 


In  the  likeness  of  Theorem  2.2  we  define 


i*  = Min  ji  : l fjh(i,j)  > C + £ f ^(OJ)1 


Then  for  all  states  (i,0)  where  i > i . , 


% 


l fh(i,j)  > C + l f,h(0,j) 


j 


i 


and  it  is  optimal  to  replace  Unit  1. 
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2.2.5  Some  Special  Cases 
When  £q  «*  1 

In  formulating  the  discrete  time  discounted  cost  model  we 
specifically  preclude  the  possibility  f^  « 1 . If  we  interpret 
f^  to  be  the  density  function  for  the  repairman's  interarrival 
times  (see  Example  (1)),  then  f^  = 1 implies  that  the  repairman 
and  the  associated  economic  advantage  in  replacement  is  always 
present.  This  is  the  case  in  the  periodic  age  replacement  model. 

It  suffices  now  to  define  the  state  of  the  system  by  the  age  of 
Unit  1 , i - 0,1,2,  ...  . The  functional  equation  governing  the 
optimal  discounted  cost  function  V(i)  is 

V(i)  = Min  (Expected  cost  if  we  replace;  Expected  cost  if  we  don't 
replace} 

« Min  (C  + oVCOjR^K  + G + aV(0))  + (1  - R ) • aV(i  + 1)}  . 

YJhen  R^  + i , it  is  easy  to  show  that  V(i)  is  monotonic  in  i 

* 

and  the  optimal  policy  structure  may  be  characterized  by  i : 

•fc 

Replace  upon  failure  or  when  the  age  of  Unit  1 equals  i where 

i*  - Min  (C  + ctV(O)  < R (K  + C + aV(0))  + (1  - R.)aV(i  + 1)}  . 

i 1 

As  before,  this  result  extends  to  the  case  of  a continuous  failure 
distribution.  Using  the  principles  of  Renewal  Theory,  Fox  [1966] 
shows  the  optimality  of  this  policy  for  a continuous  IFR  distribution 
and  a continuous  discounting  criterion. 


A. 


Series  System  of  Several  Components 


Consider  a series  system  of  several  components  where  each 
component  is  immediately  replaced  when  it  fails.  The  failure  of 
any  component  entails  a cost  for  its  replacement  plus  a fixed  cost 
K for  system  interruption.  Now  suppose  we  want  a replacement 
policy  for  some  critical  component  in  this  system.  We  regard  this 
component  as  Unit  1 and  the  rest  of  the  system  as  Unit  2 and  note 
that  Example  2 describes  this  situation.  Furthermore,  the  failure 
distribution  for  Unit  2 tends  to  the  exponential  as  its  complexity 
and  the  time  of  operation  increase  (see  Barlow  and  Proschan  [1965], 
Section  2.3).  If  past  failure  data  is  available,  it  is  easy  to 
estimate  the  parameter  that  defines  this  exponential  distribution. 
Similarly,  we  may  consider  another  critical  components  as  Unit  1 
and  determine  a replacement  policy  for  it.  This  gives  us  an  approxi- 
mate technique  to  introduce  an  opportunistic  policy  for  components 
where  we  may  realize  maximum  benefit.  Components  whose  replacement 
costs  are  small  compared  to  K are  good  choices  for  an  opportunistic 
policy. 

The  special  case  where  opportunities  to  replace  or  not  arrive 

as  a Poisson  process  receives  special  attention  in  the  next  chapter. 

Using  Renewal  Theory,  an  explicit  solution  for  the  average  cost 

* 

optimal  policy  parameter  i is  derived. 

Replacements  with  Different  Life  Distributions 

Another  situation  of  interest  arises  when  the  failure  distribution 
for  repaired-  components  is  different  than  for  original  components. 
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Let  m = 0 if  a new  component  is  in  service  and  m = i if  a used 

component  is  in  service.  Let  (i,j,m)  describe  the  state  of  the 

system,  and,  R,  and  V(i,j,m)  be  the  associated  failure  rate 
x »in 

and  the  cost  objective  respectively.  The  functional  equations 
for  this  case  are 

V(i,j,m)  - R UC  + C + aV(0, j - 1,1)}  + (1  - R ) • aV(i  + l,j  - l,m) 
x,m  x i in 

for  m = 0 , 1 and  j > 0 


and. 


V(i,0,m)  = Ri>ffi  |c  + a J fjVCO.J.Dj  + (1  - R^)  Min  |c  + a £ f.V(0,j,l); 
a ][  f^V(i  + 1»J  »m)|  f°r  m = 0 , 1 and  j = 0 . 


If  the  new  and  the  repaired  units  have  increasing  failure  rates  and, 
^ R^  q for  all  i , then  there  is  a critical  replacement  age 

/ ’k  \ 

i()  v 1 *ov  neW  (r£Pa*re<*)  unit  and  the  optimal  policy  again 

has  a simp Is  structure  as  given  in  Theorem  2.2.  The  successive 

approximation  technique  can  be  used  to  evaluate  the  cost  and 
* * 

approximate  i^  a:i*l  i1  . 

2.3  Simultaneous  Replacement  of  Two  Components 
2.3.1  Model  Formulation 

Consider  a series  system  of  two  units,  1 and  2.  The  system 
fails  when  either  unit  fails  and-  is  repaired  by  replacing  the  failed 
unit  immediately.  If  unit  n fails  we  incur  a cost  of  (K  + Cn) 
where  C is  replacement  :ost  of  component  n and  K is  the 


i 


i 


1 1 ■ 

r 

I 
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j overhead  cost  associated  with  system  failure.  When  the  system  is 

j--J-  down,  we  have  the  option  to  replace  the  nonf ailed  unit  at  its  marginal 

cost  C . In  replacing  the  nonfailed  unit  we  sacrifice  its  remaining 
n 

life  but  hope  to  forestall  the  next  system  failure. 

Clearly,  failure  epochs  of  Unit  1 (Unit  2)  are  potential 
opportunities  to  replace  Unit  2 (Unit  1).  As  in  Section  2,  we  wish 
to  determine  an  optimal  stationary  replacement  policy  that  minimizes 
the  total  expected  discounted  cost  of  maintaining  the  entire  system. 

Let  V denote  the  minimum  cost  objective  and  rr  the  "best" 
policy.  Let  a be  the  discount  rate. 

Suppose  the  system  operates  in  discrete  time  t = 0,1,2,  ...  . 

Let  (i,j)  denote  the  state  of  the  system  where  i = 0,1,2,  ...  is 
the  age  of  Unit  1 and  j = 0,1,2,  ...  is  the  age  of  Unit  2.  Suppose 
that  if  Unit  n fails  (or  is  opportunistically  replaced)  at  time 
t , it  returns  to  state  0 at  time  t + 1 . Let  IL  (P^)  denote 
the  discrete  failure  rate  of  Unit  1 (Unit  2)  at  age  i (j)  . In  this 
discrete  time  space  we  allow  the  simultaneous  failure  of  both  units. 
Given  state  (i,j)  , the  minimum  cost  function  V(i,j)  obeys  the 
functional  equation 

V (i, j ) = R±Pj  (K  + Cx  + C2  + aV(0,0)>  + R±Pj  {K  + ^ + S(0,j  + 1)} 
(10) 

+ (K  + C2  + T(i  + 1,0)}  + RjP  (eV(i  + l,j  + 1)} 

where  R,  = 1 - R , and  P.  s 1 - P , and  where 
i i j j 

(11)  S(0,j  + 1)  = Min  (C2  + aV(0,0)  ;etV(0,  j + 1)} 

T(i  + 1,0)  - Min  + aV(0,0);aV(i  + 1,0)} 


(12) 
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If  Unit  1 fails  and  Unit  2 does  not,  we  would  take  the  opportunity 
and  replace  2 only  if  S(0,j  + 1)  = C2  + aV(0,0)  . If  2 fails  and 
1 does  not,  we  would  take  the  opportunity  and  replace  1 only  if 
T(i  + 1,0)  = C1  + aV(0,0)  . 

Given  the  costs  K , , and  C2  , and  failure  rate  functions 

and  P , we  can  calculate  V(i,j)  by  using  the  successive 
approximation  technique  again: 

vk+l(i,j)  = RiPj  {K  + Cx  + C2  + aVk(0,0)}  + R±P  {K  + C±  + Sfc(0,j  + 1)} 

(13) 

+ RiPj  {K  + C2  + Tk(i  + 1,0)}  + RiPj  {«Vk(i  + l,j  + 1)} 

where 


(14)  Sk(0,j  + 1)  « Min  {C2  + aVk(0,0);aVk(0,j  + 1)} 

(15)  Tfc(i  + 1,0)  = Min  {C1  + aVk(0,0) ;aVk(i  + 1,0)}  . 
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Also  note  that  V^(i,j)  + k . Besides  its  computational  value, 

this  technique,  helps  us  to  establish  the  monotonicity  of  V in 

i and  j when  Unit  1 and  Unit  2 are  IFR.  This  ultimately  leads 

* 

to  a simple  structure  for  the  best  replacement  policy  tt 

2.3.2  Optimal  Policy  Structure 
Lemma  3-1: 

If  Unit  1 and  Unit  2 are  both  IFR  (R^  + i and  + j)  , and 
K , , and  > 0 , then  for  all  k 

(a)  Vk(iJ)  + i for  all  j 

(b)  Vk(i,j)  t j for  all  i . 

Proof: 

For  k = 0 , (a)  and  (b)  are  trivially  true  since  Vk(i,j)  = 0 
for  all  i , j . Also  observe  that  for  k = 0 , 

(a')  K + C2  + Tk(i  + 1,0)  >_  aVk(i  + l,j  + 1)  , and 

(b‘)  K + Cx  + Sk(0,j  + 1)  1 aVk(<  + l,j  + 1)  . 

Intuitively,  (a’)  and  (b * ) imply  that  no  failure  entails  no  more 
cost  than  failure  of  either  unit  for  a k period  problem. 

The  proof  proceeds  by  induction  on  k . Suppose  (a) , (b) , 
(a1),  and  (bi)  are  true  for  some  k . First,  we  show  that 
Vk+^(i,j)  + j for  all  i . Rewriting  the  iterative  equation  (13), 


A 


J 
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vk+l(i,j)  » R^P^K  + (^  + C2  + aVk(0,0)}  + P (K  + C±  + Sk<0, j + 1)}] 

+ RitPj{K  + C2  + Tfe(i  + 1,0)}  + P {aVfe(i  + l,j  + 1)}] 

= R^O)  + R±B(J)  , 

where  A(j)  and  B(j)  are  functions  of  j , given  some  value  of  i . 
We  proceed  to  show  that  both  A(j)  and  B(j)  + j for  all  i . 

A(j ) - ? {K  + Cx  + C2  + aVk(0,0)} 

+ P • Min  {K  + C1  + C2  + oVk(0,0);K  + (^  + aVk(0,j  + 1)}  . 

Since  P + j , and 

K + Ci  + C2  + aVk(°»°) 

Min  {K  + C2  +-C2  + aVk(0,0);K  + (^  + aVk(0,j  + 1)}  , 

therefore 

A(j)  1 pj+1  (K  + Ci  + c2  + aVk(0,0)} 

+ PJ+1  * Min  {K  + ^ + C2  + aVk(0,0);K  + C±  + aVk(0,j  + 1)} 
£ P {K  + Cx  + C2  + aVk(0,0)} 

+ p • Min  {K  + C1  + C2  + aVfc(0,0);K  + C±  + aVfc(0,i  + 2)} 
(since  Vk  + j for  all  i by  the  induction  hypothesis  (b)) 
= A(j  + 1)  . 


Now, 
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B(j)  «*  ?i  (K  + C2  + Tk(i  + 1,0)}  + P,  CaVk(i  + l,j  +1)}  . 
Since  Pj  + j , and  by  the  induction  hypothesis  (a*) 

K + c2  + Tk(i  + 1,0)  >_  aVk(i  + 1,3  + 1)  > 

therefore 

B<3)  1 Pj+1  {K  + C2  + Tk(i  + 1,0)}  + Pj+1  (aVk(i  + 1,3  + 1)> 

- Pj+1  *K  + C2  + Tk(i  + 1>0^  + ^j+i  {ctVk(i  + 1>J  + 

(since  VR  + 3 for  all  i) 

= B(3  + 1)  • 

Hence,  Vk+1(i,3)  * 1*^(3)  +^(.1)3  * 3 for  all  i . Similarly, 

we  can  show  that  Vk^(i»3)  + 1 f°r  3 <■ 

It  sti.ix  remains  to  show  that  assumptions  (a1)  and  (b')  extend 

to  k + 1 , That  is. 


(17) 

(a*- 

K + C2  + Tk+1(i  + l,0)  ~ <xVk+l/i  + 1,;3  + 1^ 

for  all  i , 3 • 

(18) 

(b1) 

K + ci  + Sk+1(0,  j + 1)  i °\*i(i  + 1’j  + 1) 

for  all  i , 3 • 

Equation  (17)  restated  is 

K + C2  + Min  {Cx  + «Vk+1(0,0);aVk+1(i  + 1,0)}  >_  <*\+1(i  + 1,3  + D * 
which  is  equivalent  to 

(19a)  K + Cx  + C2  + aVk+1(0,0)  j>  a\+1(i  + 1»3  + D » and 
(19b)  K + C2  + uVk+I(i  + 1,0)  1 ^+1^  + X»3  + * 
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To  see  (19a)  note  that 

aVk+1(i  + l,j  + 1) 

- «tRi+iPj+l  {K  + ci  + C2  + «Vk(0,0)}  + Ri+1Pj+1  (K  + C]L  + Sk(0,j  + 2)} 

+ Ri+1pj+1  {K  + C2  + Tk(l  + 2,0)}  + Ri+1Pj+1  <aVk(i  + 2,j  + 2)}] 

£ a[K  + Cx  + C2  + aVk (0,0)] 

<_  K + C1  + C2  + aVk(0,0)  , since  a < 1 
<_  K + C1  + C2  + aVk+1(0,0)  * since  + k . 


For  Equation  (19b) , the  left  hand  side  iB 


(K  + C2)  + aVk+1(i  + 1,0) 

(K  + C2)  + a {Ri+1p0aVk(0»0)  + Ri+lP0Sk^0,1)  + ^i+l^V1  + 2’°^ 

+ W0a\(1  + 2»1)  + Ri+ft  + P0C2  + (Ri+l  + P0  ~ Ri+lVK} 

1 (K  + C2)  + a {Ri+1«Vk(0,0)  + Ri+]Tk(i  +2,0) 

+ Ri+lCl  + P0C2  + ^Ri+1  + P0  " Ri+lP0^Kj 


= B . 


The  inequality  follows  from  oVk(0,0)  Sk(0,l)  and  Tk(i  + 2,0) 

<_  «Vk(i  + 2,1)  , The  right  hand  side  of  (19b)  is 

aVk+1(i  + l,j  + 1)  < o CRi+1(K  + Cx  + C2  + aVk(0,0) 

+ R±+1(K  + C2  + Tfc(i  + 2,0))} 


B (by  inspection)  . 


i 


I 

i 

» 

i 
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The  first  inequality  follows  from  K + + C2  + V^(0,0)  >_  K + 

+ Sk(0,j  + 2)  and  by  induction  hypothesis  (a').  Therefore,  the 
L.H.S.  >_  8 _> R.H.S.  of  Equation  (19b).  The  proof  for  Equation  (18) 
is  analogous,! 

If  we  let  k » in  Lemma  3.1,  we  get  V(i,j)  t i for  all  j , 
and  V(i,j)  f j for  all  i . This  leads  us  to  the  simple  replace- 
ment policy  given  in  the  next  theorem. 

Theorem  3.2: 

If  Units  1 and  2 are  IFR,  and  K , , and  C2  > 0 , then 

* * 

there  exists  i and  j such  that 

* 

(a)  If  Unit  1 fails  and  j >_  j , replace  both  units . Otherwise 

replace  only  the  failed  Unit  1. 

•k 

(b)  If  Unit  2 fails  and  i ^ i , replace  both  units.  Otherwise, 

replace  only  the  failed  Unit  2. 

(c)  j*  = Min  {j  : V(0, j)  > C2  + ctV(0,0)}  . 

(d)  i*  = Min  (i  : V(i,0)  > C + aV(0,0)}  . 

Proof: 

■k  * 

Define  j and  i as  above.  From  Lemma  3.1,  V(0,j)  f j 

and  V(i,0)  + i . Therefore  for  all  j >J*  , V(0,j)  > C2  + oV(0,0) 

and  Unit  2 should  be  opportunistically  replaced.  Similarly,  for 

all  i i , V(i,0)  > + aV(0,0)  which  implies  Unit  1 should 

be  opportunistically  replaced.  The  above  structure  of  the  optimal 
* 

policy  ir  follows.  ■ 


£ 
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k k 

In  practice  the  critical  replacement  ages  i and  j can 
be  approximated  by  using  the  successive  approximation  technique 
for  a large  number  of  iterations. 

2.3.3  Extensions  of  the  Model 

When  Units  1 and  2 have  continuous  IFR  distributions,  the 
preceding  results  are  again  true  for  any  discrete  approximations 
of  the  failure  rate  functions  as  well  as  for  the  limiting  continuous 
functions.  When  the  expected .average  cost  of  maintenance  is  to  be 
minimized,  a sufficient  condition  for  a stationary  optimal  policy 
to  exist  is 

V(i,j)  - V(0,0)  < N < ® . 

When  costs  K , , and  C2  are  finite,  this  condition  is  obvious- 

ly upheld.  Using  the  technique  suggested  in  Section  2,  we  can 
again  show  that  the  optimal  policy  inherits  fhe  structure  from 
the  expected  discounted  cost  case  when  both  units  are  IFR. 

The  simplicity  of  the  optimal  policy  structure  for  the  two 
models  considered  does  not  extend  to  more  complicated  systems 
with  interactive  replacement  activities.  For  example,  let  (i,j,l) 
be  the  age  vector  for  a system  of  three  units  in  serieir-..  If  Unit 
1 fails,  the  decision  to  replace  Unit  2 (Unit  3)  would  also  depend 
on  the  age  of  Unit  3 (Unit  2)  and  the  associated  cost  advantages 
thereof. 


r 
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For  convenience,  we  consider  a series  system  of  Unit  1 and 
Unit  2.  Unit  2 has  an  exponential  life  distribution  and  its 
failures  are  potential  opportunities  to  replace  Unit  1.  If  Unit 
2 fails  and  the  age  of  Unit  1 exceeds  *a',  we  replace  both  units. 

In  any  case  the  failed  unit  is  immediately  replaced.  Let  (K  + G) 
be  the  cost  of  a failure  replacement  and  C be  the  cost  of  an 
opportunistic  replacement  for  Unit  1.  Under  such  a policy. 

Section  2 examines  the  time  between  successive  failures,  successive 
replacements  and  other  quantities  of  interest.  In  Section  3,  an 
explicit  solution  for  the  average  cost  optimal  policy  is  derived. 
Section  4 examines  certain  classes  of  distributions  for  Unit  1 
which  have  received  wide  attention  in  other  replacement  models. 

3.2  Failure  and  Replacement  Intervals 

Let  F(x)  be  the  failure  distribution  function  of  Unit  1 
and,  G(x)  = 1 - e be  the  failure  distribution  of  Unit  2. 

We  first  observe  that  the  replacement  of  Unit  1,  be  it  opportunis- 
tic or  due  to  its  failure,  is  a renewal  for  the  entire  system. 

This  is  so  because  when  Unit  2 is  working,  It  is  as  good  as  new. 

If  Z denotes  the  random  time  between  successive  replacements 
of  Unit  1 and  H is  the  corresponding  distribution  function,  then 

!F(x)  for  x < a 

_ 

F(x)  * G(x  - a)  for  x >_  a 

\ 

i where  H = 1 - H and,  this  notation  is  followed  for  all  other 

I 

j distribution  functions  as  well.  The  mean  time  between  successive 

)■ 

l replacements  can  be  expressed  as 
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f 

l 


a:-. 


I 


ElZj  “ j H(x)dx 
0 


(2) 


Ct  w 

= f F(x)dx  + f F(x)G(x  - a)dx  . 
J J 


tf 

a 


A replacement  is  opportunistic  if  Unit  1 is  working  and  has 
survived  for  at  least  time  'a'  when  Unit  2 fails.  If  P^  is  the 
probability  that  any  replacement  is  opportunistic,  then 


(3) 


■/ 


F(x  + a)dG(x)  . 


To  find  the  expected  time  between  opportunistic  replacements 
we  invoke  Wald's  equation  (see  Ross  [1970]).  Let  ... 

be  a sequence  of  intervals  between  successive  replacements,  and 
suppose  that  the  replacement  is  the  first  opportunistic 
replacement.  The  Z^’s  are  independent  with  a common  distribution 
given  by  Equation  (1) . Hence  the  expected  time  between  opportunistic 
replacement  can  oe  expressed  as 


[f  ■■] 


E[Z]  • E[N]  - E[Z]/PQ 


provided  the  random  variables  have  finite  expectations.  Similarly, 
the  expected  time  between  failure  replacements  of  Unit  1 is 
E[Z]/(1  - PQ)  , 

The  distribution  of  the  time  between  successive  opportunistic 
replacements  is  a little  more  involved.  Let  denote  this 


random  interval  and  G be  its  distribution  function.  Since  we 


cannot  have  an  opportunistic  replacement  before  'a*,  therefore 
Zr  > a . We  condition  on  the  first  failure  of  Unit  1,  denoted 
by  , which  is  also  a renewal  for  the  system  and,  observe 

!S(t  - x)  for  x < a £ t 

S(t  - x)  • G(x  - a)  a £ x < t 

G(t  - a)  a £ t £ x . 


Unconditioning,  we  obtain 


1 for  t < a 

(4)  B(t)  t 

G(t  - a)F(t)  + /S(t  - x)G(x  - a)dF(x)  for  t £ a 


where  G(x  - a)  **  1 when  x £ a . 

Now  let  denote  the  random  interval  between  failure  replace- 

ments of  Unit  1 and  F be  its  distribution.  When  t < a , the 
only  kind  of  replacement  possible  is  a failure  replacement.  Therefore 
F(t)  = F(t)  for  t < a . For  t >_  a , we  condition  on  the  first 
failure  of  the  exponential  unit  after  time  'a'  and,  derive  a renewal 
type  equation  for  F as  we  did  for  G . We  obtain 


jF(t) 

(5)  F(t)  =/  t-a 

/ F(t)G(t  - a)  + jf  F(x  + a)F(t  - x - a)dG(x) 


for  t < a 
for  t > a 


Equations  (4)  and  (5)  define  G and  F implicitly  and,,  in 
principle,  can  be  solved  by  Laplace  Transforms.  For  the  various 
replacement  models  in  the  literature,  these  and  other  operating 
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characteristics  have  been  studied  by  Barlow  and  Proschan  in  [1962], 
by  Flehinger  in  [1962],  and  by  McCall  in  [1963]. 

An  analogy  with  a random  age  replacement  policy  is  due. 

Under  such  a policy,  we  replace  the  unit  at  time  T or  at  failure, 

whichever  comes  first.  We  assume  that  T has  a known  distribution 

* A 

G . Let  us  define  G as 


where  G is  the  exponential  distribution  corresponding  to  Unit  2 
in  the  opportunistic  model.  The  renewal  processes  associated 
with  this  age  replacement  and  the  opportunistic  model  now  have 
the  same  distributions. 
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3.3  Optimal  Average  Cost  Policy 


The  structure  of  the  opportunistic  policy,  as  characterized 
by  parameter  'a’,  was  shown  to  be  optimal  when  Unit  1 is  IFR  in 
Chapter  2,  Section  2.  For  the  special  case  of  an  IFR  Unit  1 in 
series  with  an  exponential  Unit  2 we  can  derive  an  explicit  solution 
for  the  optimal  value  of  ‘a*. 

From  Renewal  Reward  Theory,  the  long-run  expected  cost  per 
unit  cime,  denoted  by  <p(a)  , may  be  expressed  as 


Expected  Cost  of  a Renewal  Cycle 
Expected  Length  of  a Renewal  Cycle 

PQC  + (1  - PQ>  • <K  + C) 


where  Pq  is  the  probability  that  a replacement  is  opportunistic. 
A necessary  condition  for  the  optimal  value  of  'a1  is  obtained  by 
equating  the  derivative  of  <£(a)  to  zero.  Thereby,  we  obtain 


d (c  + K<1  - V 


da  \ E[Z) 


HUE]  • -JJ- 


HD 

fo  + c . MZ1  + K(1  - p ) .m 

da  da  0 da 


aa.  o 

Ha 


From  Equations  (2)  and  (3),  it  is  easy  to  verify  that  (dE[Z}/da)  = PQ 
Using  this  fact  and  dividing  Equation  (7)  by  KP^  , we  get 
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where  we  interpret  K as  a savings  in  a planned  replacement  over 
a failure  replacement. 

Let  r(x)  = f(x)/F(x)  represent  the  failure  rate  function 
of  Unit  1.  If  we  assume  that  r(x)  is  continuous  and  increasing, 
then  the  left  hand  side  of  Equation  (8)  is  increasing.  Therefore, 
the  optimal  policy  as  defined  by  Equation  (8)  does  exist.  If  the 

is 

optimal  a = » , we  infer  that  a policy  of  no  opportunistic  replace- 
ments is  best.  Let 


f 


i 


41 


F(a)g(a)  • J*r<y)F(y)dG(y)  - r(a)F(a)g(a)  j * F(y)dG(y)  >_  0 


Or, 


CO  CO 

J r(y)F(y)dG(y)  >_  r(a)  j F(y)dG(y) 
a a 

which  is  obvious  given  r(y)  + y . When  the  failure  rate  is  strictly 

■k 

increasing,  the  optimal  parameter  a is  finite. 

3.4  Distributions  in  Replacement 

Any  maintenance  policy  is  necessarily  aimed  against  the 
incidence  of  actual  failures  of  the  unit  under  care.  Under  an 
opportunistic  policy  as  defined  in  this  chapter,  we  would  like 
to  establish  a class  of  failure  distributions  which  reduces  the 
number  of  failures  of  Unit  1 in  a given  time  t , either  stochastically 
or  in  expected  value.  Fortunately,  the  classes  of  distributions 
relevant  to  this  replacement  model  are  already  well  known  in 
Reliability  Theory.  Marshall  and  Proschan  have  studied  these  classes 
and  established  their  importance  in  the  Age  and  Block  Replacement 
models  in  [1970] . First,  we  recall  that  a distribution  F , with 
density  f , has  increasing  failure  rate,  JFR,  if  r(t)  = f(t)/F(t) 
is  increasing  in  t . The  other  classes  for  F are  defined  below: 

A distribution  F is  New  Better  than  Used,  NBU  (New  Worse 


than  Used,  NWU)  if 
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(12)  F(x  + y)  <_  F(x)  * F(y)  for  all  x , y >_  0 . 

(l> 

A distribution  F , with  mean  0 , is  New  Better  than  Used 
in  Expectation,  NWUE,  (New  Worse  than  Used  in  Expectation,  NWUE) 
if 


(13) 


f F(x  + y)dx  <_  F(y) 
0 


for  all  y 0 . 


Each  of  the  above  classes  can  be  interpreted  as  a notion  of  aging 
and  one  can  establish  the  following  hierarchy  amongst  them,  (see 
Barlow  and  Proschan  (1975]): 


IFR  =*>  NBU  **►  NBUE 


and. 


DFR  =>  NWU  =s>  NWUE  . 


Let  {X_^}  denote  the  sequence  of  intervals  between  successive 
failures  of  Unit  1 when  no  replacement  policy  is  in  effect,  F 
denote  their  distribution  and,  N(t)  denote  the  number  of  failures 
in  (0,t)  . Let  {X^}  denote  the  intervals  between  in-service 
failures  of  Unit  1 under  an  opportunistic  policy.  The  {X^}  have 
a common  distribution  F defined  by  Equation  (5).  Correspondingly, 
N(t)  shall  denote  the  number  of  failures  in  (0,t)  . In  general, 
X±  , F , and  W depend  on  the  policy  parameter  'a’  and,  wherever 
necessary,  we  shall  specify  as  X^,(a)  , F(»,a)  and  W(t,a)  . 


t 


For  the  sake  of  results  that  follow  immediately,  we  let 

{X,  . } denote  the  intervals  between  in-service  failures  of  Unit 
i»k 

1 when  at  most  k replacements  are  permitted  between  successive 
failures.  Under  this  constrained  opportunistic  policy  we  may 
define  F^  and  N^(t)  correspondingly.  In  our  propositions 
that  relate  F with  the  in-service  failure  process,  we  shall 
use  induction  on  k and  bear  in  mind  that  Fq  *»  F , and 
F^  -*■  F as  k *»■  " . Equivalent  to  Equation  (5),  we  define  the 
in-service  failure  distribution  under  the  constrained  policy  as 

(p(t)  for 


(14)  Fk(t)  = 


for  t < a 


F(t)G(t-a)  + J F(x  + a)Fk_^(t  - x-  a)dG(x)  for  t a 


Our  first  result  shows  that  the  NBU  is  the  largest  class  which 
stochastically  increases  the  interval  between  in-service  failures 
when  we  institute  an  opportunistic  policy. 


Theorem  3.1: 

The  failure  distribution  for  Unit  1,  F , is  NBU  (NWU)  x^  k 
stochastically  increases  (decreases)  in  k for  all  exponential 
G associated  with  Unit  2,  and  policy  parameter  a >_  0 . 

Proof: 


First  we  show  that  F is  NBU  implies  ?k+1(t)  >_  F^(t)  for 
k * 0,1,2,  ...  . Since  the  x.  . are  independent  and  identically 

X,K 

distributed,  it  suffices  to  prove  the  theorem  for  i **  1 . Let 
k = 0 . Then  by  Equation  (14),  we  have 
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VC)  “ F(t)  for  t < a 

and, 

^Ct)  - *t)  • act  - a)  + / fc  + „ . F0(t  . x . a)dG(x)  for  t 

0 

ut  us  urite  • **  - «> « »<t,  - 7 *w . ^ 

0 

t-a 

^(t)  *=  F(t)  + y*  [F(x  + a)  • F(t  - x - a)  - F(t)]dG(x) 
0 

i F(t)  , since  the  integrand  is  nonnegative 
by  the  definition  of  NBU  . 

When  k = 1 t we  have 

® F(t}  for  t < a 

and, 

t-a 

?2<t)  ~ F(t)  + I [P(X  + 3)  ' Fl(t  * x " a)  - F(t)]dG(x)  for  t > a 
t-a 

1 F(t)  + / [F(x  + a)  • F(t  - x - a)  - F(t)]dG(x)  since 
0 

^(t  X ” a)  >.  F(t  - x - a)  by  the  result  proven  above 
s ?L<t)  . 


t 

\ 
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The  proof  proceeds  identically  by  induction  on 
To  show  the  converse,  we  assume  F^+^(t)  - 
all  t . It  suffices  to  consider  the  case  when 
Then, 


k . 

F^(t)  >_  0 for 
k = 0 and  t > a . 


t-a 

F (t)  - F(t)  = f [F(x  + a)  • F(t  - x - a)  - F(t)]dG(x)  0 

■**  V 

0 


for  all  G(x)  = 1 - e and  a > 0 . If  we  let  y -*■  0 the 

exponential  approaches  the  degenerate,  distribution  and  the  above 
inequality  becomes 

F(a)  ♦ F(t  - a)  - F(t)  >_  0 for  all  a > 0 , t >_  a . 

Therefore  F Is  NBU.  When  F is  NWU  all  the  inequalities  in  the 
proof  are  reversed . ■ 

Corollary  3.2; 

F is  NBU  (NWU)  <=>  W^(t)  stochastically  decreases  (decreases) 
in  k , for  al!  exponential  G and  a > 0 . 


Proof; 

Since  the  {X_^  and  {X^  k+^}  are  sequences  of  independent 
random  variables,  it  follow  from  Theorem  3.1  that 


Prob  (Mk+1(t)  1 n}  = Prob  {X1>k+1 


+ X ,,0.1  < t> 
n,k+l  — 


< Prob  (X,  , + •••  +X  . <t) 
— l,k  n,k  — 


= Prob  tW^(t)  >_  n}  . 
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For  the  converse  W.+1(t)  i.  • Therefore,  for  k = 0 we  have 

st 


Prob  {W  (t)  = 0}  - F1(t)  >_  Prob  (N(t)  = 0}  = F(t) 


Hence  F is  NBU  by  Theorem  3.1  again.  When  F is  NWU  all  the 
inequalities  are  reversed.  ■ 


Our  primary  interest  was  in  prescribing  minimal  conditions 
on  the  distribution  F which  stochastically  reduce  the  number 
of  in-service  failures  in  (0,t)  when  an  opportunistic  policy 

» 

is  introduced.  As  a direct  result  of  the  above  theorem,  we  can 

say  that  when  F is  NBU,  X.  X.  and  M(0,t)  <_  N(0,t)  for 

1 st  1 st 

any  policy  parameter  'a*  and  any  Poisson  arrival  process  for 
replacement  opportunities . 

< As  noted  earlier,  the  NBUE  is  a weaker  notion  of  aging  than 

NBU.  Correspondingly,  we  can  establish  Chat  the  NBUE  class  is 
the  largest  which  can  realize  a reduction  in  the  expected  number 
of  in-service  failures  when  an  opportunistic  policy  is  introduced. 
The  next  theorem  shall  prove  this. 

Theorem  3.3: 

The  failure  distribution  for  Unit  1,  F , is  NBUE  (NWUE) 

E[Xi  j^]  increases  (decreases)  in  k for  all  exponential  G 
associated  with  Unit  2,  and  policy  parameter  a > 0 . 

Proof: 

First  we  show  that  F is  NBUE  implies  E[X^  E[X^ 

for  k = 0,1,2,  ...  . Since  the  {X^  are  i.i.d  it  suffices 


Since  the  integrand  in  expression  (17)  is  nonnegativc  by  the 


definition  of  NBUE,  therefore 


E[Xlfl]  1 E[X] 


Now  let  k «*  1 • Corresponding  to  expression  (16),  we  get 


00  00 

E['<I  2 ^ + f f + * ^1^  " x “ " ^(t)3dt  * dG(x) 

0 x+a 


- E[X]  + J 
0 


F(x  + a)  • E[XX  x)  - J F (t)dt 

x+a 


dG(x) 


I where  we  note  that  J*  F^(t  - x - a)dt  ■ E[X^  J 

x+a  ’ ) 


> E [ X ] + f 
0 


F(x  + a)  • E[X]  - f F(t)dt 
x+a 


dG  (x) 


(since  E[X1  . ] >_  E(X]  by  the  result  proven  above) 
L 9x 

- • 


Similarly,,  the  proof  proceeds  on  induction  to  show  that  E[X^  ^+1^ 
E [X^  for  all  k . 

To  show  the  converse,  we  assume  E[X^  - E[X]  >_ 0 for  all 

a > 0 , and  G(x)  - 1 - e”*^W  . Substituting  for  these  expected 
values,  we  get 


/ 


F(x  + a)  • E[X]  - j F(t)dt 

x+a 


dG(x)  i 0 . 


i 
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If  we  let  u -*■  0 , the  exponential  approaches  the  degenerate 
distribution  and  the  above  inequality  becomes 

00 

F(a)  • E[X]  - J*  F(t)dt  >_  0 for  all  a > 0 . 
a 

Hence,  F is  NBUE.  The  results  for  NWUE  follow  by  reversing 
all  inequalities . H 

Again,  we  may  note  the  implication  of  the  above  theorem  that 
is  particularly  interesting.  If  Unit  1 has  distribution  F that 
is  NBUE,  then  the  expected  time  between  in-service  failures  in- 
creases when  we  introduce  an  opportunistic  policy  with  any  parameter 
'a'  and  any  Poisson  arrival  process  for  replacement  opportunities. 

We  now  assume  that  F conforms  to  the  strongest  notion  of 
aging  defined  before,  namely  the  IFR  class.  Under  this  assumption, 
the  optimality  of  the  policy  structure  was  proven  in  Chapter  2.  We 
shall  now  investigate  the  changes  in  the  time  between  successive 
in-service  failures  with  respect  to  changes  in  the  policy  parameter 
'a'.  First,  we  give  an  alternative  definition  of  IFR; 

F is  IFR  <=>  — AL  decreases  in  t 

F(t) 

for  each  A >_  0 . This  property  of  the  survival  function  is  called 
polya  frequency  of  order  twoy  PF»j  (see  Barlow  and  Proschan  [1975]). 

We  begin  by  establishing  an  intermediate  result  in  the  next 


lemma. 


r 
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Lemma  3.4: 

If  Unit  1 has  distribution  F that  is  IFR,  then 

Fk<t)  < F(a)Fk(t  - a)  , t >_  a , k = 0,1,2,  . . . 

for  any  policy  parameter  a > 0 and  exponential  G associated 
with  Unit  2. 

Proof: 

For  k *»  0 , Fg(t)  = F(t)  . Since  IFR  NBU,  the  result  is 
true  by  the  definition  of  NBU. 

Now  assume  the  lemma  is  true  for  some  k > 0 . It  remains 
to  extend  the  result  to  k + 1 . First  note  that 

Fk+i(t)  - Ffc(t)  for  t < (k  + l)a 
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F(x  + a)  • F^(t  - x - a)  = F(x  + a)  • F(t  - x - a) 

<_  F(a)  • F(t  - a)  since  F is  PF„  . 


Substituting  this  inequality  in  the  right  hand  side  of  Equation 
(18),  we  get 


t-2a 


Fk+i(t)  <_  F(t)G(t  - a)  + J F(x  + a)Fk(t  - x - a)dG(x) 

0 

+ F (a)F(t  - a){G(t  - 2a)  - G(t  - a)} 
t-2a 

f 

0 


^ F(a)F(t  - a)G(t  - 2a)  + / F(x  + a)FkU  - x - 2a)F(a)dG(x) 


(where  we  use  the  induction  hypothesis  F^ (t  - x - a)  < 
F(a)  • Fk(t  - x - 2a)) 

= F(a)  • Fk+1(t  - a)  . ■ 


If  we  let  k ■+■  ~ in  Lemma  3.4,  we  approach  the  unrestrained 
opportunistic  policy,  and  deduce  that 

F is  IFR  =>  F(t)  <_  F(a)  • F(t  - a)  for  all  t >_  a > 0 . 

We  are  now  ready  to  establish  that  given  F is  IFR,  the  times 
between  successive  in-service  failures  decreases  stochastically  as 
the  policy  parameter  'a'  increases.  This  also  implies  a reduction 
in  the  mean  time  between  in-service  failures. 


I 


Theorem  3.5: 


If  Unit  1 has  an  IFR  distribution,  F , then  , i **  1,2,  . . 
decreases  stochastically  in  policy  parameter  a > 0 for  all 
exponential  G associated  with  Unit  2. 


Proof: 


It  suffices  to  show  that  — F(t,a)  < 0 for  all  a > 0 when 

da  — 

t < a , — F(t,a)  = ~ F(t)  *>  0 and  the  theorem  is  trivially  true. 

d r 

Assume  that  — F(t,a)  < 0 for  t < na  . Then,  for 
da  — 

t < (n  4-  l)a  , 


F(t,a)  = 


F(t)G(t  - a)  + J F(y)F(t  - y,a)dG(y  - a)| 


(where  y » x + a) 


= i F(t)G(t  - a)  + i Jf( y)F(t  - y,a)dG(y  - a) 

a 

- ^ F(a)  • F(t  - a, a)  + J F(y)  • F(t  - y,a)jdG(y  - 


— (F(t,a)  - F(a)  * F(t  - a, a)}  + 


t 

f ' ^da  “ y*a^dGCy  - *)  • 


The  first  term  on  the  right  hand  side  of  Equation  (19)  is  non- 
positive by  Lemma  3-4.  For  the  second  term,  note  that  when 
t < (n  + l)a  , t - y <_ na  for  y e (a,t)  . Therefore, 
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— F(t  - y,a)  <_  0 by  the  induction  hypothesis.  Hence, 

F(t,a)  < 0 for  t < (n  + l)a 
da  — 

and  by  induction  it  follows  that  this  result  extends  to  any  t 
when  a > 0 . I 

From  Theorem  3.5  we  see  that  when  in-service  failures  have 
to  be  minimized,  the  policy  parameter  'a*  should  be  set  to  zero. 
This  would  mean  that  every  time  an  opportunity  arises  (i.e.  the 
repairman  visits  or  Unit  2 fails)  we  should  replace  Unit  1.  This 
would  naturally  entail  an  increase  in  the  total  number  of  replace- 
i ments  required  to  maintain  the  unit.  In  general,  we  would  like 

to  weigh  the  costs  of  in-service  failure  replacements  against 
opportunistic  replacements  and  select  the  optimal  policy  as  defined 


in  Section  3.3. 
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